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Pye-koko di i ka vwe Iwen, mache ou ke vwe pH Iwen. 1 



Creole proverb from Guadeloupe that can be translated: The coconut palm says 
it sees far away, walk and you will see far beyond. 
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Preface 



The preface is that part of a book which is written last, placed first, and 

read least. 

Alfred J. Lotka 
Elements of Physical Biology 
Baltimore: Williams & Wilkins Company 1925 



The purpose of this book is to show how models of complex systems are built 
up and to provide the mathematical tools indispensable for studying their 
dynamics. This is not, however, a book on the theory of dynamical systems 
illustrated with some applications; the focus is on modeling, so, in present- 
ing the essential results of dynamical system theory, technical proofs of theo- 
rems are omitted, but references for the interested reader are indicated. While 
mathematical results on dynamical systems such as differential equations or 
recurrence equations abound, this is far from being the case for spatially ex- 
tended systems such as automata networks, whose theory is still in its infancy. 
Many illustrative examples taken from a variety of disciplines, ranging from 
ecology and epidemiology to sociology and seismology, are given. 

This is an introductory text directed mainly to advanced undergraduate 
students in most scientific disciplines, but it could also serve as a reference 
book for graduate students and young researchers. The material has been 
taught to junior students at the Ecole de Physique et de Chimie in Paris and 
the University of Illinois at Chicago. It assumes that the reader has certain 
fundamental mathematical skills, such as calculus. 

Although there is no universally accepted definition of a complex system, 
most researchers would describe as complex a system of connected agents that 
exhibits an emergent global behavior not imposed by a central controller, 
but resulting from the interactions between the agents. These agents may 
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be insects, birds, people, or companies, and their number may range from a 
hundred to millions. 

Finding the emergent global behavior of a large system of interacting 
agents using analytical methods is usually hopeless, and researchers there- 
fore must rely on computer-based methods. Apart from a few exceptions, 
most properties of spatially extended systems have been obtained from the 
analysis of numerical simulations. 

Although simulations of interacting multiagent systems are thought exper- 
iments, the aim is not to study accurate representations of these systems. The 
main purpose of a model is to broaden our understanding of general principles 
valid for the largest variety of systems. Models have to be as simple as pos- 
sible. What makes the study of complex systems fascinating is not the study 
of complicated models but the complexity of unsuspected results of numerical 
simulations. 

As a multidisciplinary discipline, the study of complex systems attracts 
researchers from many different horizons who publish in a great variety of 
scientific journals. The literature is growing extremely fast, and it would be a 
hopeless task to try to attain any kind of comprehensive completeness. This 
book only attempts to supply many diverse illustrative examples to exhibit 
that common modeling techniques can be used to interpret the behavior of 
apparently completely different systems. 

After a general introduction followed by an overview of various modeling 
techniques used to explain a specific phenomenon, namely the observed cou- 
pled oscillations of predator and prey population densities, the book is divided 
into two parts. The first part describes models formulated in terms of differen- 
tial equations or recurrence equations in which local interactions between the 
agents are replaced by uniform long-range ones and whose solutions can only 
give the time evolution of spatial averages. Despite the fact that such models 
offer rudimentary representations of multiagent systems, they are often able 
to give a useful qualitative picture of the system’s behavior. The second part 
is devoted to models formulated in terms of automata networks in which the 
local character of the interactions between the individual agents is explicitly 
taken into account. Chapters of both parts include a few exercises that, as 
well as challenging the reader, are meant to complement the material in the 
text. Detailed solutions of all exercises are provided. 



Nino Boccara 



Contents 



Preface vii 

1 Introduction 1 

1.1 What is a complex system? 1 

1.2 What is a model? 4 

1.3 What is a dynamical system? 9 

2 How to Build Up a Model 17 

2.1 Lotka-Volterra model 17 

2.2 More realistic predator-prey models 24 

2.3 A model with a stable limit cycle 25 

2.4 Fluctuating environments 27 

2.5 Hutchinson’s time-delay model 28 

2.6 Discrete-time models 31 

2.7 Lattice models 33 



Part I Mean-Field Type Models 



3 Differential Equations 41 

3.1 Flows 41 

3.2 Linearization and stability 51 

3.2.1 Linear systems 51 

3.2.2 Nonlinear systems 56 

3.3 Graphical study of two-dimensional systems 66 

3.4 Structural stability 69 

3.5 Local bifurcations of vector fields 71 

3.5.1 One-dimensional vector fields 73 

3.5.2 Equivalent families of vector fields 82 

3.5.3 Hopfbifurcation 83 

3.5.4 Catastrophes 85 



X 



Contents 



3.6 Influence of diffusion 91 

3.6.1 Random walk and diffusion 91 

3.6.2 One-population dynamics with dispersal 92 

3.6.3 Critical patch size 94 

3.6.4 Diffusion-induced instability 95 

Exercises 98 

Solutions 100 

4 Recurrence Equations 107 

4.1 Iteration of maps 107 

4.2 Stability 110 

4.3 Poincare maps 118 

4.4 Local bifurcations of maps 120 

4.4.1 Maps on R 120 

4.4.2 The Hopf bifurcation 125 

4.5 Sequences of period-doubling bifurcations 127 

4.5.1 Logistic model 128 

4.5.2 Universality 131 

Exercises 136 

Solutions 139 

5 Chaos 145 

5.1 Defining chaos 147 

5.1.1 Dynamics of the logistic map 149 

5.1.2 Definition of chaos 153 

5.2 Routes to chaos 154 

5.3 Characterizing chaos 156 

5.3.1 Stochastic properties 156 

5.3.2 Lyapunov exponent 158 

5.3.3 “Period three implies chaos” 159 

5.3.4 Strange attractors 161 

5.4 Chaotic discrete-time models 169 

5.4.1 One-population models 169 

5.4.2 The Henon map 169 

5.5 Chaotic continuous-time models 174 

5.5.1 The Lorenz model 174 

Exercises 176 

Solutions 177 



Part II Agent-Based Models 



Contents 



xi 



6 Cellular Automata 191 

6.1 Cellular automaton rules 191 

6.2 Number-conserving cellular automata 194 

6.3 Approximate methods 207 

6.4 Generalized cellular automata 213 

6.5 Kinetic growth phenomena 221 

6.6 Site-exchange cellular automata 228 

6.7 Artificial societies 243 

Exercises 258 

Solutions 262 

7 Networks 275 

7.1 The small- world phenomenon 275 

7.2 Graphs 276 

7.3 Random networks 279 

7.4 Small-world networks 283 

7.4.1 Watts-Strogatz model 283 

7.4.2 Newman- Watts model 286 

7.4.3 Highly connected extra vertex model 287 

7.5 Scale-free networks 288 

7.5.1 Empirical results 288 

7.5.2 A few models 292 

Exercises 299 

Solutions 301 

8 Power-Law Distributions 311 

8.1 Classical examples 311 

8.2 A few notions of probability theory 317 

8.2.1 Basic definitions 317 

8.2.2 Central limit theorem 320 

8.2.3 Lognormal distribution 324 

8.2.4 Levy distributions 325 

8.2.5 Truncated Levy distributions 328 

8.2.6 Student’s t-distribution 330 

8.2.7 A word about statistics 331 

8.3 Empirical results and tentative models 334 

8.3.1 Financial markets 335 

8.3.2 Demographic and area distribution 339 

8.3.3 Family names 340 

8.3.4 Distribution of votes 340 

8.4 Self-organized criticality 341 

8.4.1 The sandpile model 341 

8.4.2 Drossel-Schwabl forest fire model 343 

8.4.3 Punctuated equilibria and Darwinian evolution 345 

8.4.4 Real life phenomena 347 



Contents 



xii 



Exercises 352 

Solutions 354 

Notations 367 

References 371 

Index 389 



1 



Introduction 



This book is about the dynamics of complex systems. Roughly speaking, a 
system is a collection of interacting elements making up a whole such as, 
for instance, a mechanical clock. While many systems may be quite compli- 
cated, they are not necessarily considered to be complex. There is no precise 
definition of complex systems. Most authors, however, agree on the essential 
properties a system has to possess to be called complex. The first section is 
devoted to the description of these properties. 

To interpret the time evolution of a system, scientists build up models, 
which are simplified mathematical representations of the system. The exact 
purpose of a model and what its essential features should be is explained in 
the second section. 

The mathematical models that will be discussed in this book are dynamical 
systems. A dynamical system is essentially a set of equations whose solution 
describes the evolution, as a function of time, of the state of the system. There 
exist different types of dynamical systems. Some of them are defined in the 
third section. 



1.1 What is a complex system? 

Outside the nest, the members of an ant colony accomplish a variety of fasci- 
nating tasks, such as foraging and nest maintenance. Gordon’s work [152] on 
harvester ants 1 has shed considerable light on the processes by which members 
of an ant colony assume various roles. Outside the nest, active ant workers 
can perform four distinct tasks: foraging, nest maintenance, patrolling, and 
midden work. Foragers travel along cleared trails around the nest to collect 
mostly seeds and, occasionally, insect parts. Nest-maintenance workers modify 
the nest’s chambers and tunnels and clear sand out of the nest or vegetation 

1 Pogonomyrmex barbatus. They are called harvester ants because they eat mostly 
seeds, which they store inside their nests. 
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from the mound and trails. Patrollers choose the direction foragers will take 
each day and also respond to damage to the nest or an invasion by alien ants. 
Midden workers build and sort the colony’s refuse pile. 

Gordon [150, 151] has shown that task allocation is a process of continual 
adjustment. The number of workers engaged in a specific task is appropriate 
to the current condition. When small piles of mixed seeds are placed out- 
side the nest mound, away from the foraging trails but in front of scouting 
patrollers, early in the morning, active recruitment of foragers takes place. 
When toothpicks are placed near the nest entrance, early in the morning at 
the beginning of nest-maintenance activity, the number of nest-maintenance 
workers increases significantly. 

The surprising fact is that task allocation is achieved without any central 
control. The queen does not decide which worker does what. No master ant 
could possibly oversee the entire colony and broadcast instructions to the 
individual workers. An individual ant can only perceive local information from 
the ants nearby through chemical and tactile communication. Each individual 
ant processes this partial information in order to decide which of the many 
possible functional roles it should play in the colony. 

The cooperative behavior of an ant colony that results from local interac- 
tions between its members and not from the existence of a central controller 
is referred to as emergent behavior. Emergent properties are defined as large- 
scale effects of locally interacting agents that are often surprising and hard to 
predict even in the case of simple interactions. Such a definition is not very 
satisfying: what might be surprising to someone could be not so surprising to 
someone else. 

A system such as an ant colony, which consists of large populations of 
connected agents (that is, collections of interacting elements), is said to be 
complex if there exists an emergent global dynamics resulting from the actions 
of its parts rather than being imposed by a central controller. 

Ant colonies are not the only multiagent systems that exhibit coordinated 
behaviors without a centralized control. 

Animal groups display a variety of remarkable coordinated behaviors [278, 
64] . All the members in a school of fish change direction simultaneously with- 
out any obvious cue; while foraging, birds in a flock alternate feeding and 
scanning. No individual in these groups has a sense of the overall orderly pat- 
tern. There is no apparent leader. In a school of fish, the direction of each 
member is determined by the average direction of its neighbors [339, 331]. In 
a flock of birds, each individual chooses to scan for predators if a majority of 
its neighbors are eating and chooses to eat if a majority of its neighbors are 
already scanning [23]. The existence of sentinels in animal groups engaged in 
dangerous activities is a typical example of cooperation. Recent studies sug- 
gest that guarding may be an individual’s optimal activity once its stomach 
is full and no other animal is on guard [90]. 

Self-organized motion in schools of fish, flocks of birds, or herds of ungulate 
mammals is not specific to animal groups. Vehicle traffic on a highway exhibits 



1.1 What is a complex system? 



3 



emergent behaviors such as the existence of traffic jams that propagate in the 
opposite direction of the traffic flow, keeping their structure and characteristic 
parameters for a long time [183], or the synchronization of average velocities 
in neighboring lanes in congested traffic [184]. Similarly, pedestrian crowds 
display self-organized spatiotemporal patterns that are not imposed by any 
regulation: on a crowded sidewalk, pedestrians walking in opposite directions 
tend to form lanes along which walkers move in the same direction. 

A high degree of self-organization is also found in social networks that 
can be viewed as graphs. 2 The collection of scientific articles published in 
refereed journals is a directed graph, the vertices being the articles and the 
arcs being the links connecting an article to the papers cited in its list of 
references. A recent study [295] has shown that the citation distribution — that 
is, the number of papers N( x) that have been cited a total of x times — has a 
power-law tail, N{x) ~ x~ a with a ss 3. Minimally cited papers are usually 
referenced by their authors and close associates, while heavily cited papers 
become known through collective effects. 

Other social networks, such as the World Wide Web or the casting pat- 
tern of movie actors, exhibit a similar emergent behavior [37]. In the World 
Wide Web, the vertices are the HTML 3 documents, and the arcs are the links 
pointing from one document to another. In a movie database, the vertices are 
the actors, two of them being connected by an undirected edge if they have 
been cast in the same movie. 

In October 1987, major indexes of stock market valuation in the United 
States declined by 30% or more. An analysis [321] of the time behavior of 
the U. S. stock exchange index S&P500 before the crash identifies precursory 
patterns suggesting that the crash may be viewed as a dynamical critical 
point. That is, as a function of time t, the S&P500 behaves as (t — A) 0 ' 7 , 
where t is the time in years and t c ~ 1987.65. This result shows that the stock 
market is a complex system that exhibits self-organizing cooperative effects. 

All the examples of complex systems above exhibit some common charac- 
teristics: 

1. They consist of a large number of interacting agents. 

2. They exhibit emergence ; that is, a self-organizing collective behavior dif- 
ficult to anticipate from the knowledge of the agents’ behavior. 

3. Their emergent behavior does not result from the existence of a central 
controller. 

The appearance of emergent properties is the single most distinguishing 
feature of complex systems. Probably, the most famous example of a system 
that exhibits emergent properties as a result of simple interacting rules be- 
tween its agents is the game of life invented by John H. Conway. This game is 

2 A directed graph (or digraph) G consists of a nonempty set of elements V(G), 
called vertices, and a subset E(G) of ordered pairs of distinct elements of V(G), 
called directed edges or arcs. 

3 Hypertext Markup Language. 
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played on an (infinite) two-dimensional square lattice. Each cell of the lattice 
is either on (occupied by a living organism) or off (empty). If a cell is off, it 
turns on if exactly three of its eight neighboring cells (four adjacent orthogo- 
nally and four adjacent diagonally) are on (birth of a new organism). If a cell 
is on, it stays on if exactly two or three of its neighboring cells are on (sur- 
vival), otherwise it turns off (death from isolation or overpopulation). These 
rules are applied simultaneously to all cells. Populations evolving according to 
these rules exhibit endless unusual and unexpected changing patterns [137]. 

“To help people explore and learn about decentralized systems and emer- 
gent phenomena,” Mitchell Resnick 4 developed the StarLogo 5 modeling en- 
vironment. Among the various sample projects consider, for example, the 
project inspired by the behavior of termites gathering wood chips into piles. 
Each cell of a 100 x 100 square lattice is either empty or occupied by a wood 
chip or/and a termite. Each termite starts wandering randomly. If it bumps 
into a wood chip, it picks the chip up and continues to wander randomly. 
When it bumps into another wood chip, it finds a nearby empty space and 
puts its wood chip down. With these simple rules, the wood chips eventually 
end up in a single pile (Figure 1.1). Although rather simple, this model is 
representative of a complex system. It is interesting to notice that while the 
gathering of all wood chips into a single pile may, at first sight, look surpris- 
ing, on reflection it is no wonder. Actually it is clear that the number of piles 
cannot increase, and, since the probability for any pile to disappear is nonzero, 
this number has to decrease and ultimately become equal to one. 6 



1.2 What is a model? 

A model is a simplified mathematical representation of a system. In the ac- 
tual system, many features are likely to be important. Not all of them, how- 
ever, should be included in the model. Only the few relevant features that 
are thought to play an essential role in the interpretation of the observed 
phenomena should be retained. Models should be distinguished from what is 
usually called a simulation. To clarify this distinction, it is probably best to 
quote John Maynard Smith [234]: 

4 See Mitchell Resnick’s Web page: http : //mres . www .media .mit . edu/people/mres. 
Resnick’s research is described in his book [297]. 

5 StarLogo is freeware that can be downloaded from: 

http: //el .www.media.mit . edu/groups/el/Projects/ starlogo . 

6 Here is a similar mathematical model that can be solved exactly. Consider a 
random distribution of N identical balls in B identical boxes, and assume that, 
at each time step, a ball is transferred from one box to another, not necessarily 
different, with a probability P{n — > n ± 1) of changing by one unit the number 
n of balls in a given box depending only on the number n of balls in that box. 
Moreover, if this probability is equal to zero for n = 0 (an empty box stays 
empty), then it can be shown that the probability for a given box to become 
empty is equal to 1 — n/N. Hence, ultimately all balls end up in one unique box. 
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Fig. 1.1. Star Logo sample project termites. Randomly distributed wood chips (left 
figure) eventually end up in a single pile (right figure) . Density of wood: 0.25; number 
of termites: 75. 



If, for example, one wished to know how many fur seals can be 
culled annually from a population without threatening its future sur- 
vival, it would be necessary to have a description of that population, 
in its particular environment, which includes as much relevant detail 
as possible. At a minimum, one would require age-specific birth and 
death rates, and knowledge of how these rates varied with the density 
of the population, and with other features of the environment likely 
to alter in the future. Such information could be built into a simula- 
tion of the population, which could be used to predict the effects of 
particular management policies. 

The value of such simulations is obvious, but their utility lies 
mainly in analyzing particular cases. A theory of ecology must make 
statements about ecosystems as a whole, as well as about particular 
species at particular times, and it must make statements which are 
true for many different species and not for just one. Any actual ecosys- 
tem contains far too many species, which interact in far too many 
ways, for simulation to be a practical approach. The better a simula- 
tion is for its own purposes, by the inclusion of all relevant details, the 
more difficult it is to generalize its conclusions to other species. For 
the discovery of general ideas in ecology, therefore, different kinds of 
mathematical description, which may be called models, are called for. 
Whereas a good simulation should include as much detail as possible, 
a good model should include as little as possible. 

A simple model, if it captures the key elements of a complex system, may 
elicit highly relevant questions. 

For example, the growth of a population is often modeled by a differential 
equation of the form 








